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1.  Introduction 

Let  X  be  a  random  vector  and  let  X^.,,,,.)^  be  its  partition 
into  k  sub-vectors.  Let  pt  denote  the  dimension  of  X  ,t*l, . . . ,k,  and 

p 

let  be  a  subset  of  R  .,  where  R  *  (-«,»).  The  statistical 
dependence  between  the  sub -vectors,  given  by  the  inequality 

k 

(1.1)  P  (X  e  E«.,  t*l , .  . .  ,k}  >  n  PCX.  e  EJ 

t  t  ~  t-1 

is  of  interest  in  certain  problems,  such  as,  life  testing  and 
interval  estimation.  The  above  inequality  has  been  considered 
by  Dunn  (1958),  Dykstra  (1979),  Khatri  (1967,  1970),  Sidak  (1967, 
1968,  1975),  Scott  (1967),  Slepian  (1962)  and  Tong  (1970),  for 
the  case  in  which  the  distribution  of  X  is  multivariate  normal. 

In  this  paper  we  give  some  new  results  on  the  inequality. 

Let  the  distribution  of  X  be  multivariate  normal  with  mean 
vector  £  and  covariance  matrix  £  =  (ajj)»  and  let  pt  *  1 , 
t*l,...,k.  If  each  Et  is  an  interval  symmetric  about  the  origin, 
then  the  inequality  (1.1)  follows  from  Theorem  1  of  Sidak  (1968). 

For  the  one  sided  case,  that  is,  when  each  Et  is  an  interval 
of  the  form  (-®,at)  or  each  Et  is  of  the  form  (at,®),  then  the 
inequality  holds  if  _>  0  (i^j)  by  a  result  due  to  Slepian 
(1962).  The  reverse  inequality  holds  if  £  0  (i^j). 

Let  (£jj)  be  the  partition  of  E,  where  denotes  the 
covariance  between  X^  and  Xj .  Let  k  *  2  and  let  r  denote  the 
rank  of  E^*  The  inequality  (1.1)  follows  from  Theorem  1  of 
Khatri  (1967)  if  r  *  1  and  E^  and  E?  are  convex  sets,  symmetric 
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about  the  origin.  In  a  subsequent  paper,  Khatri  (1970)  claimed 
that  the  inequality  holds  also  for  r  >  1.  However,  the  proof 
of  the  generalization  given  by  the  author  was  found  incorrect 
by  Sidak  (1975).  On  the  other  hand,  Dykstra  (1979)  showed 
that  the  inequality  holds  for  r  >  1  if  Ej  is  a  convex  symmetric 
set  and  E?  is  the  interior  of  an  ellipsoid  given  by  X^A)^  <  c, 
where  AI^  is  an  idempotent  matrix.  In  this  paper,  we  generalize 
the  result  of  Dykstra.  Moreover,  we  show  that  the  inequality 

(1.1)  holds  for  r  >  1  if  I  satisfies  a  given  condition  and 
and  E^  are  both  increasing  (decreasing)  sets .where  a  set  E  is 
said  to  be  an  increasing  (decreasing)  set  if  X  e  E  and  2>(<)x 
then  y.  e  E .where  >(<)  means  (£)  component  wise. 

Very  few  results  are  known  for  the  case  in  which  the 
underlying  distribution  is  not  assumed  to  be  multivariate  normal. 

A  set  of  random  variables  Yi>**’>Yn  are  said  to  be  associated 
if  the  covariance  between  f(Y^,...,Yn)  and  g(Y^ , . . . ,Yn)  is  non¬ 
negative  for  all  functions  f  and  g  which  are  nondecreasing  in 
each  argument.  The  variables  Y^ ....  ,Yn  are  said  to  be  positively 
orthant  dependent  if  the  following  inequality  holds  for  all 
values  a^. 

(1.2)  P (Y .  <  a.,  i-1 . n)  >  S  P(Y.  <  a.). 

l  -  1  “  i-i  1  ~  1 

The  above  inequality  holds  if  Yi»*’*>Yn  are  associated  by  Theorem 
5.1  of  Esary , Proschan  and  Walkup  (1967).  In  Section  3  we  show  sta¬ 
tistical  dependence,  including  the  association  between  certain 
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quadratic  forms,  and  in  Section  4  we  introduce  the  concept  of 
negative  association. 

2.  Probability  Inequalities 

Consider  the  inequality  (1.1)  for  k=2.  Let  ^ ,X2  be  jointly 
normally  distributed  with  mean  vector  £  and  covariance  matrix  E 
Let  Ej be  a  convex  set  symmetric  about  the  origin  and  let  E2  denote 
the  interior  of  the  ellipsoid  given  by  X2AX2  <  c,  where  A  is 
a  positive  semi-definite  matrix.  We  shall  show  that  the  inequality 

(1.1)  holds  under  certain  conditions  on  A  and  E.  First  we  give 
a  lemma  whose  proof  is  given  at  the  end  of  the  section.  The 
lemma  is  required  in  the  proof  of  Theorems  2.1  and  2.2  below. 

Lemma  2 . 1  Given  s  >  r  *  rank  (E12)  *  there  exist  matrices  E13 
and  Z32  °f  order  p-^xs  and  sxp2  .respectively , such  that  ^12*^13^32’ 
Moreover,  E-q  -  ^^3^31  an<^  ^22  ”  S23^32  are  Positive  definite, 
where  E31  ■  E13  and  E23  “S32- 

Let  SS"  *  E11  -  £13£31  and  TT"  =  E22  -  ^23^32*  wIiere  Z13 
and  E23  are  constructed  form  Lemma  2.1.  Then  the  joint  distribusion 
of  Xx,  X2  can  be  represented  as  follows: 

xL  *  su  +  e13  W 

(2.1) 

*2  "  T¥  +  Z23  5 

where  U,  V  and  W  are  normally  distributed  independent  random 

vectors,  U  d  N(0,I  )  ,  V  d  N(0,  I  )  and  W  *  N(0,I  ) .  Clearly, 

"  pi  “  “p2  “  “  s 

X1 ,  X2  are  conditionally  independent  given  W. 
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Theorem  2.1.  The  inequality  (1.1)  holds  for  k=2  if  (i) 

-  Z 23^32)  an  idempotent  matrix  and  (ii)  *  nls 

for  some  positive  number  n,  where  Z^  is  constructed  from  Lemma  2.1. 

1 

Proof.  Let  Q  =  W'W  and  Y  =  Z^  H  Q~ 2  •  From  the  sufficiency, 

completeness  and  invariance  considerations  we  find  that  Y  is 

independent  of  Q.  From  the  representation  (2 . 1)  we  have  that 

1 

given  Wj ,  is  normally  distributed  with  mean  vector  Y  Q5  and 
X2AX2  is  distributed  according  to  a  noncentral  chi-square  distribu¬ 
tion  with  noncentrality  parameter  equal  to  nQ.  Thus 

(2.2)  P(X1£E1,X2£E2)  =  EwP(X1eE1|W)  P(X2eE2|W) 

*  EQ[P(X2£E2|Q)  EyP(Xi£E1 |Y,Q)]  . 

Clearly,  P(X2eE2jQ)  is  a  decreasing  function  of  Q.  Moreover 
EyCXi£Hi|Y,Q)  is  a  non  increasing  function  of  Q  by  Theorem  1 
of  Anderson  (1955).  Therefore  by  Kimball's  inequality  the  quan¬ 
tity  on  the  right  side  of  (2.2)  is  greater  than  or  equal  to 


EpP(X2eE2!Q).  Ep>yP(X1eE1|Y,Q)-  P(XeE1)  P(X2eE2)  . 

The  theorem  is  proved. 

Corollary  2.1.  The  inequality  (1.1)  holds  for  k*2  if  A*Z22*Ip  . 

2 

Proof:  Let  e  be  a  small  positive  number  such  that  Z^- (Z12-2p  /  (1- e) 
is  a  positive  definite  matrix.  Then  Z^*(l-£)*^  Z^2  and  Z2 -  * 
(l-£)iIp  satisfy  the  conditions  of  Lemma  2.1.  It  is  sufficient  to 
prove  the  corollary  for  A  ■  e**Ip  . 


Now  the  conditions  of  Theorem  2.1 
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are  satisfied  for 
the  inequality  (1.1) 


A  3  £  *1  , E7?  *  I  and  n  *  (1  e)/e.  Hence 

P2  lc  P2 

holds.  A  slightly  different  proof  of  the 


above  corollary  has  been  given  by  Dykstra  (1979). 

Corollary  2.2.  The  inequality  (1.1)  holds  for  k*2,  if  AI22 
is  an  idempotent  matrix. 


The  proof  of  Corollary  2.2  is  omitted. 

There  is  a  large  class  of  matrices  I  and  A  for  which  Theorem  2.1 


is  applicable.  An  example  is  given  here  for  illustration: 
Let 


) 


Note  that  Corollary  2.2  is  not  applicable  since  AZ22  is  not  an  idem- 
potent  matrix. 

Next,  we  consider  the  case  in  which  E^  and  E2  are  both  decreas¬ 
ing  or  both  increasing  sets.  A  matrix  is  called  nonnegative  if  its 
elements  are  nonnegative.  Let  Z^3  and  Z23  be  constructed  from  Lemma  2.1 

Theorem  2.2.  The  inequality  (1.1)  holds  for  k*2,  if  Z^3  and  Z23  are 
nonnegative  matrices  and  and  E2  are  decreasing  (increasing) 
sets. 

Proof:  From  the  representation  (2.1)  we  have 


(2.3) 


P(X1£E1,X2eE2)  -  E^P C^1£E1  i  W)  P (2^2 £E 2  j  W)  . 


Let  Ex  and  E2  be  decreasing  sets.  Since  Ex  is  a  decreasing  set 
and  EX^ | W  *  £13W,  where  Z13  is  a  nonnegative  matrix,  it  follows 
that  PCX^EjJW)  is  non-increasing  in  each  component  of  W.  Similar¬ 
ly  P(X2£E2l^  is  non- increasing  in  each  component  of  W.  As  the 
components  of  W,  being  independent,  are  associated  we  have 

(2.4)  EWP(X1£E11W)P(X2£E2|W)  >  EwP(X1£E1lw)EwP(X2eE2IW) 

*P(X1£E1)P(X2eE2)  . 

The  conclusion  of  the  theorem  follows  from  (2.3)  and  (2.4).  The 
above  result  is  proved  similarly  for  the  case  in  which  E^  and  E2 
are  increasing  sets. 

Corollary  2.3.  The  inequality  (1.1)  holds  for  k=2  if  £ 12  is  a 
nonnegative  matrix  of  rank  1. 

Proof:  Let  £^2  can  be  written  as  \  ]/  where  i  is  a  p^xl  vector 

and  Hs  a  p7xl  vector.  Since  X  u  _>  0  for  all  i  and  j,  all  non- 
zero  components  of  X_  and  w  have  the  same  sign.  So  it  may  be  assumed 
that  \  and  U  are  nonnegative  vectors.  The  conditions  of  Theorem  2.2 
are  satisfied  by  letting  I^3  »  X  and  E23  *  jj. 

Corollary  2.4.  Let  X^,...,X^  be  jointly  normally  distributed 
and  let  their  covariance  matrix  be  nonnegative.  Then  X^,...,X^  are 
positively  orthant  dependent. 

The  above  corollary  follows  directly  from  Corollary  2.3. 

It  is  a  special  case  of  a  more  general  result  due  to  Slepian  (1962) . 
The  proof  is  omitted. 

A  repeated  application  of  Corollary  2.3  shows  that  the 
inequality  (1.1)  holds  for  k  >  2  in  the  following  cases, where  the 
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covariance  matrix  E  is  given  by  (i)  =  1,  ,  *  p  >  0,  i  f  j, 

(ii)  a—  *  ^  for  all  i  and  j,  (iii)  ■  l,  p„  ■  p  >  0  for 

I i - j |  =  1,  zero  otherwise. 

A  matrix  A  is  said  to  be  completely  positive  if  A  =  PP^  where  P 
is  a  nonnegative  matrix.  Let  A  be  of  order  n  *  n  and  let 
A(i,  s , . . . ,n | j , s , . . . ,n)  denote  the  minor  of  A  with  rows  indexed  by 
i,s,...,n  and  columns  indexed  by  j,s,...,n.  A  sufficient  condi¬ 
tion  for  a  nonnegative  positive  definite  matrix  to  be  completely 
positive  is  that  A(i,s,...,n|j,s,...,n)  >  0  for  1  _<  i  ,  j  _<  s  and 
2  <  s  <  n  by  Corollary  5.1  of  Markham  (1971). 


Corollary  2.5.  The  inequality  (1.1)  holds  if  Z (i  , s  , . .  .  ,n  |  j  , s  , .  . .  ,n)  >0 
for  1  <  i,  j  <  s,  and  2  <  s  <  ntwhere  n  denotes  the  order  of  E. 


Proof:  Let  k  *  2.  The  conditions  of  the  corollary  imply  that  Z  is 
completely  positive  and  so  also  is  E-e:In  for  sufficiently  small  e  >  0. 
Therefore  let  Z  -eln  *  PP',  where  P  is  nonnegative.  Let  P^,  P^ 
be  a  partition  of  P  where  P^  is  of  order  p^xn  and  P2  is  of  order 
P2xn.  Then  E-^  *  P^P^'  ’£*p  *  PP{>  ^22  ’  e^2  ~  ^2P2  '  ^et 

Zfj  =  Px  and  Z23  *  P2»  Then  Z12  *  2i3232’  Moreover  Z^  -  Z13Z31 

and  Z22  *  ^23^32  are  Posifive  definite. Then  the  inequality  (1.1) 
follows  from  the  application  of  Theorem  2.2.  A  repeated  application 
of  the  above  proof  yields  the  inequality  for  k  ^  2. 


Proof  of  Lemma  2.1.  Let  Aj,...,Ar  denote  the  positive  characteristic 
roots  of  si2Z22lz'?l2ll*  Since  2  is  Positive  definite,  it  follows 
that  Z^  -  - 1 2s  2 2  21  is  Positive  definite.  Therefore  0  <  A^  <  1 
for  i  *  1 , . . . ,r . 


8. 


Let  P^  and  P2  be  non-singular  matrices  such  that  P^li^l  * 

Im  and  P £ S 2 2 P 2  =  *n*  the  s*-n8ular  value  decomposition  theorem 

there  exist  orthogonal  matrices  and  Q2,  such  that 

Q£P{Zi2P2Q2  «  D 

where  D  =  (d^)  is  given  by  d^.  =  0,  i?j  ,  d^  *  X^2  for  i-l,...,r 
and  d. i  =  0  for  i  >  r,  i=l,...,m  and  i=l,...,n.  Let  A  „  =  (a..) 
denote  an  mxs  matrix  in  which  a^j  =  0  for  i^j  ,  a^  =  xV^ 
i*l,...,r,  a^  *  0  for  i  >  r,  i*l,...,m,  j*l,...,s.  Now  let 

Z13  =  C p i 1 ) Q i Am ^ s  and  Z23  =  (P21)  Q2An,s 

since  k  k'  „  •  D,  we  have  that  E,.,  *  EnTE,,.  Furthermore  the 
m,s  n,s  12  13  31 

matrix  E^  -  E^E^  is  positive  definite  since  it  can  be  written 
as 

Z11  '  Z13Z  31  *  QiCQipiX 

where  C  is  an  mxm  diagonal  matrix,  the  diagonal  elements  being 
1/2  1/2 

1-Xj  , . . . ,1-Xr  ,1, .  .  -  ,1.  Similarly  the  matrix  ^22’Z23Z32  *s  Positive 
definite . 


3.  Association  of  Quadratic  Forms 
Let  Y  be  normally  distributed  with  mean  vector  £  and  covariance 
matrix  E  .  In  this  section  we  give  some  results  on  the  statistic,0’ 
dependence  among  the  quadratic  forms  Y'  A^  Y,  i»l,...,k,  where 
A^  are  positive  semidefinite  matrices. 
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Theorem  3.1.  The  correlation  between  two  quadratic  forms 
Y'A^Y  and  Y'A^Y  is  nonnegative. 

Proof:  By  direct  computation  we  have 

(3.1)  cov(Y'AiY,Y"A.Y)  =  2  trace  A^A^Z. 

Since  A^  and  A^  are  positive  semidef inite ,  the  right  side  of  (3.1) 
is  nonnegative  by  Theorem  9 . 1 . 28  of  Graybill  (1969). 

Remark.  If  A.ZAj  is  positive  semidefinite  then  it  can  be  shown 
that  the  conclusion  of  the  theorem  holds  without  the  assumption 
that  EY  =  0. 

Association  between  two  random  variables  implies  that  the 
correlation  between  the  variables  is  nonnegative.  Theorems  3.2  through 
3.4  below, give  certain  conditions  for  the  association  of  quadratic 
forms.  We  say  that  the  matrices  A^  are  diagonalized  simultaneously 
through  a  non-singular  transformation  if  there  exists  a  non-singular 
matrix  P  such  that  PA^P'*D^,  where  D^,  is  a  diagonal  matrix,  i  =  l,...,k. 
Clearly  the  diagonal  elements  of  each  are  nonnegative.  If  for 
example, A^Aj  ■  A^A^  f°r  each  pair  (i,j),  then  the  matrices  A^  are 
diagonalized  simultaneously  through  an  orthogonal  transformation. 

Theorem  3.2.  Let  n  =  k  =  2.  If  A^  and  A2  can  be  diagonalized 
simulatenous ly  then  Y'A^Y  and  Y'A^Y  are  associated. 

Proof:  Under  the  conditions  of  the  theorem  we  can  assume  without 
loss  of  generality  that  A^  and  A2  are  diagonal  matrices.  Also,  Z 
can  be  assumed  to  be  a  correlation  matrix.  Let  p  denote  the 
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2 

correlation  between  Y^  and  Y2.  Now,  Y^  is  conditionally  distributed, 

■>  2  2 

given  Y”,  as  (1-p  )  X  ^  5  ,  a  non-central  chi-square  with  1  degree 

2  2  2 

it  freedom  and  non-centrality  parameter  5=  p  Y,  /  (1-p  ).  Thus 

2  2 

the  conditional  distribution  of  Y^  given  Y?  is  stochastically  increas- 
■>  2  2 

ing  in  Y,  .  Therefore,  Y^  and  Y^  are  associated  by  theorem  4.7 

of  Barlow  and  Proschan  (1975).  The  theorem  follows,  since  Y'A^Y 

2  7 

and  Y'A^Y  are  non-decreasing  functions  of  Y1  and  Y^. 

Suppose  that  the  components  of  Y  can  be  grouped  in  pairs, 
that  is  Y  =  (X^,...,Xp  where  each  X^  is  a  two-component  vector. 

Let  each  A^  be  of  order  2x2.  The  proof  of  theorem  3.1  below 
is  straightforward. 


Theorem  5.3.  If  X^  and  Xj  are  uncorrelated  (i^j),  and  A^,...,Ak 
can  be  diagonalized  simultaneously  then  X^A^^X^  , .  .  .  ,X^AkXk  are 
associated. 

Suppose  that  the  matrices  A^  commute  pairwise  with  respect 

to  Z  ,  that  is  A^EA.  =  A  ■  ZA^  (i^j).  Then  through  a  non-singular 

it  2 

transformation  we  can  write  Y'A^Y  =  £  a^Zt,  i*l,...,k,  where 
aij  il  0  anc*  ^l,,,,,^n  are  ^dependent  normal  random  variables. 
Therefore,  we  have  the  following  result. 


Theorem  3.4.  If  A^,...,Ak  commute  pair  wise  with  respect  to  Z  then 
Y"A^Y , . . . ,Y"AkY  are  associated. 


The  property  of  association  of  random  variables  is  observed 
in  many  statistical  models.  Consider,  for  example,  the  model 

,  i*l , 2 , . . . . 


Yi 


sYi-i  * 


for  a  time  series,  where  are  independent  random  variables.  The 
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distribution  of  given  depends  on  Y^_^  only,  by  the 

Markov  property.  If  p  >  0  then  the  conditional  distribution  is 

stochastically  increasing  in  sequence.  On  the  other  hand,  if  the 

distribution  of  each  is  unimodal  and  symmetric  about  the  origin 

2  2  2 

then  the  conditional  distribution  of  Y^  given  Y^,. . .,Y^_1  is  stochas- 

? 

tically  increasing  in  Y^_^  and  thus  the  joint  distribution  of 

Yi,...,Yn  is  stochastically  increasing  in  sequence.  It  follows 

from  theorem  4.7  of  Barlow  and  Proschan  (1975)  that  Y.,...,Y  are 

2  2 

associated  if  p  >  0,  and  that  are  associated  if  the  dis¬ 

tribution  of  each  is  unimodal  and  symmetric  about  the  origin. 


4.  Negative  Association 

The  definition  of  association  between  a  set  of  random  vari¬ 
ables,  given  above,  implies  positive  dependence  in  the  sense  that 
large  (small)  values  of  any  subset  of  the  given  variables  are 
associated  with  large  (small)  values  of  any  other  subset  of  the 
variables.  A  weaker  form  of  dependence  and  of  the  opposite  kind 
is  implied  by  the  definition  of  negative  association,  given  below. 
The  random  variables  X^,...,X^  (k^2)  are  negatively  associated  if 
the  covariance,  when  it  exists,  between  f(Y)  and  g(ZJ  is  non¬ 
negative  for  all  nondecreasing  functions  f  and  g,  where  Y  and  Z  are 
subvectors  representing  a  partition  of  the  given  variables  into  two 
subsets.  Two  examples  of  negatively  associated  random  variables 
are  given  below. 

Example  4.1.  Let  X  *  (X^,...,X^)  be  distributed  according 
to  the  multivariate  normal  distribution  with  mean  vector  0  and 
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covariance  E  =  where  *  1,  =  -p  (ifj)  and  0  <  p  < 

(k-1)  * .  Let  the  subvectors  Y  and  Z  be  obtained  through  a  parti¬ 
tion  of  the  components  of  X.  As  the  mean  of  the  conditional  dis¬ 
tribution  of  Y  given  1  is  for  each  component,  a  linear  function  of 
the  components  of  Z  with  negative  coefficients,  the  conditional 
distribution  of  Y  given  Z  is  stochastically  decreasing  in  each 
component  of  Z.  Therefore,  the  conditional  expection  of  f(Y) 
given  Z  is  nondecreasing  in  the  components  of  Z  for  any  non¬ 
decreasing  function  f.  An  application  of  Kimball's  inequality 
gives 


E  f(Y)g(Z)  <  E  f(Y)  E  g(Z). 

Therefore,  the  random  variables  X2’‘‘’,Xk  are  negatively  associated. 

Example  4.2.  Let  the  random  variables  Xj,...,Xk  be  jointly 
distributed  according  to  the  Dirichlet  distribution,  given  by 
the  density  function 


^  » •  •  •  » ^ck) 


r(vj+...+vk)  v.-i 

ITvj77T.r(vk)  ’“xk 


vk_1 


k 

where  x^  >  0  (i*l,...,k),  £  x^ 

can  be  represented  as  follows: 


-  1. 


The  Dirichlet  distribution 


xA  -  V.  /  S  ,  i*l,...,k 

where  V,  , . .  .  ,V.  are  independent  gamma  random  variables  with 
1  K  k 

v .,..., v .  degrees  of  freedom,  respectively,  and  S  *  V  V..  From 

1  K  i*l  1 

the  above  representation  it  follows  that  the  conditional  distribution 


of  Y  given  Z  is  stochastically  decreasing  in  Z,  where  Y  and  1 
are  defined  as  in  the  previous  example.  Therefore,  the  random 
variables  X^,...,Xk  are  negatively  associated.  The  Dirichlet 
distribution  arises  in  goodness  of  fit  tests  based  on  sample 
spacings  (seee.g.  Pyke  (1965)). 

It  is  easy  to  show  that  the  following  sets  of  random  vari¬ 
ables  are  negatively  associated:  (i)  independent  random  variables, 
(ii)  nondecreasing  functions  g^(X^)  of  negatively  associated  random 
variables  X^'s  ,  (iii)  union  of  independent  sets  of  negatively 
associated  random  variables.  .  Also,  it  follows  directly  from  the 
definition  of  negative  association  that  the  reverse  inequality 
holds  in  (1.1)  for  k  ■  2  if  and  E2  are  nondecreasing  sets  and 
the  components  of  X  are  negatively  associated. 
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